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We extend Jarzynski's work relation and the second law ol thermodynamics to a heat conducting 
system which is operated by an external agent. These extensions contain a new nonequilibrium 
contribution expressed as the violation of the (linear) response relation caused by the operation. 
We find that a natural extension of the minimum work principle involves information about the time- 
reversed operation, and is far from straightforward. Our work relation may be tested experimentally 
especially when the temperature gradient is small. 
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Thermodynamics is a universal framework for macroscopic systems in equilibrium. The second law, which is at 
the heart of thermodynamics, gives strict limitations to macroscopic operations and provides fundamental concepts 
such as irreversibility and minimum work. The idea of minimum work leads to the useful Gibbs relation, which 
represents work associated with a thermodynamic operation as the difference in the free energy. To develop similar 
useful thermodynamics for nonequilibrium systems is a fascinating challenge. In [J-Qj attempt has been made to 
construct operational thermodynamics for nonequilibrium steady states (NESS). A central idea was to replace the 
"bare heat" in NESS by its "renormalized" counterpart called excess heat. 

Recently there has been a considerable progress in nonequilibrium physics which in particular led to the fluctuation 
theorem Q and the Jarzynski equality 0, [l^. The former gives an exact equality for the entropy production in NESS, 
which is connected to response relations. The latter provides an exact relation between operational work and the 
free energy not only in quasi-static but also in general operations in equilibrium. It is also directly connected to the 
second law of thermodynamics. 

In the present Letter, we focus on mechanical work associated with an external operation in NESS realized in 
classical heat conducting systems. We derive a very natural extension ([1]) of the Jarzynski equality to NESS, which 
may be tested experimentally. The extended equality straightforwardly implies the Gibbs relation (jS]) for the quasi- 
static limit and the second law (j?]). These relations contain new nonequilibrium contributions expressed as the 
violation caused by the external operation of the linear response relation. The derivation of the results are essentially 
straightforward and is based on the detailed fluctuation theorem (also known as the microscopic reversibility or 
the local detailed balance condition). We hope that these findings become crucial steps in the understanding and 
construction of thermodynamics for NESS. 

Setup: Our theory can be developed in various nonequilibrium settings of classical stochastic systems. For sim- 
plicity we here focus on heat conduction, and consider a system which is attached to two heat baths with inverse 
temperatures /3i and /32 and has controllable parameters v. An example is a system of N particles in a container in 
which the position v of one of the particles is controlled by the external agent (see Fig. 1). The inverse temperatures 
/3i and P2 are fixed throughout, and are often omitted. We define /3 :— (/3i -f /?2)/2 and Aji :— j3i — /?2. 
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FIG. 1: An example of the system, where the position 1/ of & particle (green online) can be controlled externally. Ji and J2 are 
the heat currents from the heat baths to the system. 



The coordinates of N particles are collectively denoted as F = (ri, . . . , rjv; pi, . . . , pjv), and its time- reversal as 
r* = (ri, . . . , rjv; — Pi, • • ■ , —Pn)- The time evolution of the system is governed by deterministic dynamics according 
to the Hamiltonian H,y{T) and stochastic Markovian dynamics due to coupling to the two external heat baths. We 
impose time-reversal symmetry H,j{T) — H„{T*). When discussing time evolution of F, we denote by F(t) its value 
at time t, and by F = (F(t))(g[_T£.T£] the path in the whole time interval [—Ti,Ti\. The heat baths may be realized in 



standard manners such as "thermal walls" (see, e.g. 11|) or the Langevin noise near the walls. The only (and the 



essential) requirement is that the detailed fluctuation theorem (see pT|) below) is valid. By Jk{T;t), we denote the 
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heat current that flows from the k-ih bath to the system at time t in the path f = (r{t))te[-Te,Te] UM- We write 
J{T; t) — {Ji{T; t) — J2(r; t))/2, which is the heat current from the first to the second heat bath. 

V(t) 
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FIG. 2: A sketch of the protocol />. We assume ti ~ and Ts — Tq ^ where is the relaxation time of the system. 

We shall assume that the system settles to a unique NESS when it evolves for a sufficiently long time with fixed v. 
For later convenience we shall choose and fix three time scales < Tq < Tg < T£ such that — Tg 3> Tj- and Tg — Tq 3> 
where t-^ is the relaxation time of the system. See Fig. 2. We suppose that an external agent performs an operation 
to the system by changing the parameters v according to a prefixed protocol. A protocol is specified by a function 
v{t) of t € [—Ti,Te\. In order to study transitions between NESS, we assume that v{t) varies only for t G [— ro,To], so 
that v{t) ^ V ior t ^ [— T£, — Tq] and v{t) = v' for t G [ro,Tf]. We denote by i> = {^{'t))te[-Ti,Ti] the whole protocol, 
by = the time-reversal of i), and by {i^) the protocol in which the parameters are kept constant 

at i^. During the operation, the external agent performs mechanical work I1^(r) = J^°^ di9,yiJ,y{r(t))|j^^j^(t)t'(t) to 
the system. We denote by Qt(r) — Jj"^ dtJ(T;t) the heat transferred from the first to the second heat bath during 
[-Ts,Ts]. Similarly, we write Q\(f) = J^^^ dtJ{r;t) and g[(f) = Q dtJ{t;t). 

The time evolution of the system is described by a Markov process. We denote by 7i>[r] the transition probability 
associated with a path F in a protocol v. It is normalized as / PF 7^[r](5(F(— r^) — Fj) = 1 for any initial state Fj, 
where / VT{- ■ ■ ) denotes the integral over all the possible paths F. For any function /(F), we define its average in 
the protocol v as (/)'' := / Vtpf{T{-Tt))To[t]f{f), where pf{T) is the probability distribution for the unique NESS 
corresponding to the parameters v = v{—ti). 

Jarzynski equality for NESS: In [Tsj . we introduced a nonequilibrium free energy F{i') which is a function of the 
parameter v (as well as /3i and /32), and coincides with the equilibrium free energy for Pi = ^2- Here we show that, 
for any /3i, /32, and operation v, the exact identity 

(^e-^iw-AF)y ^(^^APQ.yJ^^ (1) 

is valid, where AF := F(zy') — F{i'). The identity ([1]) is our most basic result. Here we introduced a modified 
expectation 

(fV -^Sl H L (2) 

^^"^ ■ (e^'3Qi/2 gA0Ql/2y ' ^ ^ 

where /(F) is an arbitrary function 13]. Obviously ([T|) reduces to the celebrated Jarzynski equality for /3i = /32- We 
would like to propose ([1]) as the most natural nonequilibrium extension of the Jarzynski equality to NESS. 

Let us stress that VF(r) is the standard mechanical work, and the left-hand side of ([T|) can be evaluated experimen- 
tally (exactly as in the case of the original Jarzynski equality). Although the right-hand side may appear artificial, 
we shall show below that this quantity can also be evaluated experimentally (at least when the NESS is close to 
equilibrium). To be specific, we show below in ^ that this modified expectation is directly connected to the well- 
known linear response relation by rewriting the modified expectation in terms of heat currents. We recall that (•■•)'' 
represents the average in a physically natural time evolution with the time-reversed protocol. 

We also note that since W^(r) = for a constant protocol i> — {v), the equality ([T]) implies (e^^'^^)'m' = 1- This is 
a version of the integrated fluctuation theorem and is related to a response relation as usual (see [14j). We can say 
that the equality ([T]) reveals an intimate relation between the mechanical work in NESS and the response relation. 
We shall see later that a deviation of (e^'^*^')5^ from 1 corresponds to a violation of the response relation. 

Quasi-static limit: Since W^(r) essentially does not fluctuate in the quasi-static limit, one has {e'^^)" — e^*^^^^". 
By also noting that (W)"^ — -(W)" in this limit, ^ reduces to 

{wy = AF + r'M^^'''')l (3) 
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which is an exact relation corresponding to the Gibbs relation in equilibrium thermodynamics. 

The equilibrium Gibbs relation leads to potentials which describe macro- or mesoscopic forces. The equality ([3]), 
however, implies that we may not have such potentials in NESS as log(e^^'^')|^ is not necessarily described by a 
difference of a state function. 

The second law for NESS: From Jensen's inequality, we have log(e~'^^^~^^^)'' > ~j5{{WY — AF)^ which implies 

{Wy>AF-T'\og{e^^Q^)'^, (4) 

where the equality holds in the quasi-static limit. We believe that this is a natural extension of the second law of 
thermodynamics to operations between NESS. It is notable that the right-hand side involves a quantity in the reversed 
protocol v"^ . 

The inequality (|4]) implies that the minimum work principle is not extended straightforwardly to NESS. The quantity 
equated with the free energy difference is not the work but the sum of the work and log(e^^'3t^^^ _ This apparently 
means that one must invoke the reversed protocol v'^ to find the limitation of the work. 

Expansion in weak nonequilibrium regime: We define a dimensionless parameter indicating the degree of nonequi- 
librium by e = |Z\/3|//3. We here deal with systems with small e and ignore the contribution of 0{€^). 

Let us now derive a compact approximate expression ^ for the right-hand side of ([1]). From the definition ([2]) of 
the modified expectation , we have 

log(e^^«');^ = log(e^^'?'/2e^^«'e^^«'/2)'' - log(e^^Qi/2gZi/^Ql/2^^_ 
By applying the cumulant expansion to the right-hand side and arranging the result by order, we have 

\og{e^^Q^)l = Ap{Q,Y + ^(Qt; iQ[ + Qt + Qi))" + 0{e% (6) 
where (A; B) = {AB) - {A){B). Since Qt(T) = /^;^ dtJ(f; t) and Ql{r) + Qtit) + Ql{t) = J^'^^ dtJ(f; t), we have 

log(e^^O')l = r '^^"^vioiW + 0(e3), (7) 

where we have defined 

4oiW - {Jit)y + ^ r ds{Jit);Jis)f. (8) 



In the steady protocol (i^), we have the linear response relation (LRR) for heat currents [l7, 18| and thus J^^QiCi) = 
(more exactly, 0(e^)). More generally the equality (e^^'^t^f^) — i gives an exact response relation for (J(t))(") 
because it connects (J(t))'^"^ to the higher cumulants of J{T;t). 

When there is an operation, the LRR is violated in general and J^^^^{t) does not vanish. We can thus interpret 
J^j^[(i) as the ^^violation of LRR^ due to the external operation. Similarly, the deviation of {e^^'^^)'^ from 1 can be 
regarded as the violation of the exact response relation. We have thus reached the most important interpretation of 
the equality ([1]); the mechanical work in NESS is related to the violation of the response relation. 

In equilibrium operations at Ap = 0, we see that J^jQj(t) = {J{t)Y corresponds to the heat current induced by 
the external operation. This enables us to intuitively understand the role played by J'^-^^y{t) in a weak NESS. In an 
equilibrium system the induced current {J{t)Y requires no "costs", and hence does not appear in thermodynamic 
relations. In a NESS, on the other hand, any heat current is coupled to the temperature difference. This is the reason 
that we have Aj3{J{t)Y in our thermodynamic relation. 

Derivation of (jl7p ; We shall prove our main observation ([T|). The proof relies on the detailed fluctuation theorem 
dTTI) and the exact representation ([T?| for the probability distribution of NESS. It is essentially straightforward. 

Let us decompose the time intervals as [—ti,ti] = [— r^,— Tg] U [— Ts,rs] U [rs,r^], and, correspondingly, a path 
as r = (ri,rm,rf). For an arbitrary function / of — (r(t))jg[_T-^ t^j, the following expectation is naturally 
decomposed as 
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where we used Q[(r) = Qti^i) and Q[(f ) = Ql{ff). {■ ■ ■ )st,r or (■ • • )s,st is properly defined conditioned expectation 
with a fixed final state T or initial state S [16| . We also introduced unnormalized expectation [• • • ] by 

(10) 



[/]r,s = pt*(r) j OT„j(f „05(r(-r,) - r)(5(r(T3) - s)r,[f 

where 7i[r,„] is the transition probability for Fm. 

The transition probability 7^[rm] is known to satisfy the detailed fluctuation theorem, 

r,[f,j en../3.Q.(f»)^r,t[ftj, 



(11) 



where 7^t [f J„] is the transition probability of the time reversed path f]^ = (r{—t))t£[-Ts,Ts] for the reversed protocol 
0^ . QkiTm) = dtJk{Tni',t) is the total heat that flows from the bath k to the system during the path Fm. By 
using the energy conservation Hi,>{r{Ts)) — i/iy(F(— Tg)) = VF(fm) + X]fc=i Qki^m), (ITT|) is rewritten as 



(12) 



where we noted that Qt{Tl^) = — (5t(fm)- By integrating over fm with constraints F(— Tg) = F and F(ts) — ^, and 
recalling (|10l) . we have 



p^.'(r) 



(13) 



In 15|, we derived (also by using the detailed fluctuation theorem (fTTj) ) the exact representation for the probability 
distribution in NESS with parameters i', 



pt'(r) = e^(^('')-^'^(^» 



r*,st 



(14) 



where the normalization factor F{iy) was identified as a nonequilibrium free energy. By substituting (jl4l) into (|13l) . 
one gets 



/3P'(i')^pZi/3Qi/2^('-) 



st.r 



By integrating over F and S, and using (jlOp . this implies 

^gZi/3Qi/2g-/9(lV-/iF)gZi^Qf/2^'' ^ ^g4^Q;/2gZi^QtgZl/JQf/2^'' 

Noting that (e^^<3l/2e^/30t/2)^ ^ (^^Af)Ql/2^Af!Ql/2^i>^ ^j^^ ^j^jg reduces to 



0^ 

H*,r' 



/r*,st 



\ / m \ / m ' 



(15) 



(16) 



(17) 



Since the operation takes place in the interval [— Tq, Tq], there is no correlation between W(r) and e^'^'^'/^ or e^'^'^E/s^ 
This means that the left-hand side of PT)) can be replaced by the usual expectation to give the desired ([T]). 

Discussions: We have derived nonequilibrium extensions of the Jarzynski work relation ([l}, the Gibbs relation 
([3]), and the second law Q in a general classical model of heat conduction. Although one can show that the Gibbs 
relation ^ approximated to O(e^) coincides with the extended Clausius relation that we have derived in all 
the other results are novel. Especially, it is fascinating that thermodynamic relations and response relations are 
coupled intrinsically in our relations. The traditional understanding has been that thermodynamic relations work 
for equilibrium operations, and response relations work for nonequilibrium steady states. Here, by considering an 
operation for NESS and proving the extended Jarzynski equality ([T]), we have shown that the two paradigms are 
naturally unified in a single exact relation. 

There has been many works on the violation of fluctuation-dissipation relation including an effective temperature 
for characterizing relaxation processes [20| . the formula for estimating the energy dissipation [H, 22|, and the linear 
response around NESS 23|, |2J| . It would be suggestive to look for possible relations of these topics with the present 
study. 
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Although we have restricted ourselves to the simplest setting here, it is straightforward to extend the present results 
to the case where the inverse temperatures /3i and P2 vary, or to other nonequilibrium systems. The only essential 
requirement is the detailed fluctuation theorem PT|) . 

Last but not least let us stress that all of our main results (H}, ([3]), and ^ may be tested experimentally especially 
when the degree of nonequilibrium e is small. Although we still do not know whether these results have practical 
applications, it would be exciting to imagine applying the exact Jarzynski equality (HJ to the analysis of the efficiency 
of a thermodynamic machine operating in NESS. 

The author thanks T. S. Komatsu, S. Sasa and H. Tasaki for fruitful discussions and suggestions. This work was 
supported by KAKENHI (19540392 and 23540435). 
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